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APPARATUS AND METHOD FOR 
HANDLING SPECIAL WINDOWS IN A DISPLAY 

CROSS-REFERENCE TO RELATED APPLICATION 
This application is related to co-pending U.S. Patent Application Serial 
No, 08/900,964, entitled "System And Method For Generating High-Luminance 
Windows On A Computer Display Device", filed on July 25, 1997, which is 
incorporated by reference. These related applications are commonly assigned. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates generally to display devices, and relates more 
particularly to an apparatus and method for handling special windows in a 
display. 

2. Description of the Background Art 

Efffective presentation of visual information is an important 
consideration for manufacturers, designers, and users of displays. Such 
displays are commonly used for interfacing with computers. Many modern 
computer operating systems use graphical user interfaces that enclose 
information from application programs in separate viewing areas or windows in 
a display to simplify information management. 
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These special windows in a display may be used for presentation of 
different types of information than are typically shown in the remainder of the 
display. In some applications, use of a special window in a display may be 
desirable to help distinguish or differently process information. For example, a 

5 computer system may present video information from a video source (such as a 
video camera or video tape recorder) in a special window, while simultaneously 
presenting more traditional computer-generated information such as text and 
graphics in the rest of the display. 

Conventional computer displays are designed to present text and 

10 graphics, but are not specifically designed to present video information. 

Luminance levels in conventional computer displays are usually considerably 
lower than the luminance levels used in conventional video monitors or 
television screens. Video information presented in conventional computer 
displays thus appears to have less contrast between bright and dark areas, and 

15 tends to look rather murky. Raising luminance levels is one possible way to 
enhance the presentation of video information in computer displays, but 
problems may arise from indiscriminately raising luminance levels over the 
entire display surface. 

For example, text or graphics outside the special window may become 

20 blurred, decreasing the overall effectiveness of the display. Furthermore, 
continuously raising luminance levels over the entire display surface may 
unacceptably accelerate the aging of the display tube. These problems could 
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be avoided with an effective means for identifying and locating the limited 
portions of a special display window to be advantageously processed. 

The coordinates of a special display window may be transmitted to a 
display via a separate data channel. For example, the serial interface available 

5 on most modern computers may be dedicated to this purpose. However, this 
potential solution presents a number of difficulties. First, such a system would 
demand significant additional hardware within a computer system; a second 
serial interface card would have to be managed by the computer system. 
Second, the signals generated by such serial interface hardware would have to 

10 be precisely calibrated with the horizontal and vertical video synchronization 
signals going to the display. Finally, significant software development would be 
required to coordinate such a dual-channel interface system. 

Therefore, for the foregoing reasons, an improved apparatus and method 
for handling special windows in a display is needed, in accordance with the 

15 present invention. 
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SUMMARY OF THE INVENTION 



In accordance with the present invention, an apparatus and method 
are disclosed to handle special windows in a display. 
5 In one embodiment of the present invention, windows comprise 

frames that are created by an operating system, and content areas that are 
created by an application program. The windows are special if they include 
content areas or portions of content areas that are to be specially processed, 
such as being displayed with higher than normal luminance. Software 
10 developers preferably trigger special window creation by calling a window 

manager, which includes operating system functions specifically designed to 
simplify special window use. 

In accordance with the present invention, special windows include key 
signals that enable display circuitry to identify windows to be specially 
15 processed. The key signals also include information needed by display 
circuitry to locate the boundaries of the portion of the content area to be 
specially processed. The key signals are preferably static patterns in a 
special window, so that no separate signals or second communication 
channel beyond the existing video interface are required to trigger special 
20 processing. The operating system places digital representations of all 
display information, including special windows, into a video RAM in the 
preferred embodiment. The existing video interface circuitry scans the video 
RAM and produces video signals to be sent to the display. A window 
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decoder in the display detects the key signals, extracts the embedded 
special window information from the key signals and controls the display 
circuitry performing the special processing desired. 

Key signals are patterns of colored pixel (picture element) pairs. A 

5 color coding scheme enables storage of key signal information in a manner 
that is easily detectable by the window decoder, yet is not visually 
discernible, given the limited acuity of the human eye. In additive color 
display systems, primary colors (red, green, blue) can be mixed to produce 
secondary colors (yellow, cyan, magenta). If a pixel of a primary color is 

10 placed next to a pixel of an opposite secondary color (that is, one not 
including the primary color) of equal luminance, the resulting pixel pair 
resembles a single pixel that is an achromatic gray in color. This enables 
the key signal to be plainly displayed in a gray window frame without 
causing visual distraction. One primary color channel serves as the data 

15 signal, and another is used as a complement to produce the achromatic 
gray color of pixel pairs. 

The key signal color coding scheme preferably uses the remaining 
primary color channel in the existing video interface as a video clock signal. 
A separate clock in the window decoder is synchronized to the video clock 

20 signal when a key signal is present. The separate but synchronous internal 
clock is continuously available to the window decoder, and enables the use 
of a precise but relative (versus absolute) display coordinate system. The 
location of any pixel in the display can be determined and controlled by the 
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time elapsed since the last horizontal and vertical synchronization pulses in 
the existing video interface. No second communications channel for 
transmission of external timing pulses for precise pixel location is required. 
The window decoder can use key signal information and existing 

5 synchronization pulses to control the timing, and thus location, of special 
processing for desired portions of the display with respect to the upper left 
corner of the display. 

Key signal information includes start and stop sequences, code 
sequences to distinguish a key signal from other display data, horizontal 

10 and vertical offset values, and a CRC checksum. The horizontal and vertical 
position of the key signal and the horizontal and vertical offset values can be 
summed by the window decoder to yield the coordinates of the portion of the 
content area to be specially processed. The window decoder uses the other 
sequences in a variety of means for verifying the presence of a window 

15 intended to be specially processed. Accidental special processing could be 
very distracting to the user and should be avoided. For example, key 
signals preferably identifying upper left and lower right corners of the 
portion of the content area to be specially processed should be detected in 
one scan, and should persist for a set number of scans. Similarly, code 

20 sequences should match a pair of preset sequences, and three bits of 

unchanging color, as in a gray frame, should be present prior to the start 
sequence of each key signal. Many other conditions used to avoid 
accidental special processing are described in the detailed description of the 
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present invention. Once the window decoder enables special processing, the 
window decoder disables special processing only when no special windows 
exist, or when the special window is occluded by another window. 

The present invention therefore handles special windows in a display, 
5 enabling more effective presentation of visual information. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a block diagram for one embodiment of a computer system, in 
accordance with the present invention; 

FIG. 2 is a diagram for one embodiment of the display of FIG. 1, 
including a window, in accordance with the present invention; 

FIG. 3 is a block diagram for one embodiment of the RAM of FIG. 1, in 
accordance with the present invention; 

FIG. 4 is a block diagram showing one embodiment for the processing of 
display data, in accordance with the present invention; 

FIG. 5 is a diagram for one embodiment of a window in the FIG. 1 
display, in accordance with the present invention; 

FIG. 6 is a timing diagram for one embodiment of display data encoded 
into exemplary pixels, in accordance with the present invention; 

FIG. 7 A is a block diagram for the preferred embodiment of the FIG. 5 
key signals, in accordance with the present invention; 
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FIG. 7B is a table describing one embodiment for components of the FIG. 
7B key signals; 



FIG. 8 is a block diagram for the preferred embodiment of the FIG. 4 
5 window decoder, in accordance with the present invention; and 



FIG. 9 is a flowchart for one embodiment of method steps to process 
special windows, in accordance with the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 



The present invention relates to an improvement in displays, including 
computer displays. The following description is presented to enable one of 
ordinary skill in the art to make and use the invention and is provided in the 

5 context of a patent application and its requirements. Various modifications to 
the preferred embodiment will be readily apparent to those skilled in the art 
and the generic principles herein may be applied to other embodiments. Thus, 
the present invention is not intended to be limited to the embodiment shown 
but is to be accorded the widest scope consistent with the principles and 

10 features described herein. 

The present invention comprises an apparatus and method for handling 
special windows in a display. The invention uses a modified display window 
frame created by a window manager from an operating system, and 
transmitted to the display over a video interface. This window frame includes 

15 key signals with unique characteristics that are visually unobtrusive, and yet 
are easily detected and processed by display circuitry to identify and locate 
special windows for advantageous processing, in accordance with the present 
invention. 

20 Referring now to FIG. 1, a block diagram for one embodiment of a 

computer system is shown, in accordance with the present invention. 
Computer system 100 preferably comprises a central processing unit (CPU) 
1 10, a display 1 12, an input device 1 14, a data storage system 1 16, a video 



random access memory (VRAM) 120, a random access memory (RAM) 122, a 
read-only memory (ROM) 124, and a video generator 126. Each element of 
computer system 100 is preferably coupled to a common data bus 118. 
Input device 114 may alternatively comprise various configurations, 
5 including elements such as a keyboard or a mouse. Data storage system 
116 may also alternatively comprise various configurations, including 
elements such as a floppy disk or a hard disk. Computer system 100 of the 
present invention may include, but is not limited to, an Apple Macintosh ® 
computer system. 

10 

Referring now to FIG. 2, a diagram for one embodiment of display 1 12 of 
FIG. 1, including a window 200, is shown, in accordance with the present 
invention. Display 1 12 of the preferred embodiment may include, but is not 
limited to, a cathode-ray-tube based video monitor. However, other types of 

15 commonly used displays including liquid-crystal-based displays may 
alternatively be encompassed by the present invention. Information is 
preferably updated on display 1 12 in a rastered manner, i.e., display 1 12 is 
periodically scanned horizontally from left to right and then vertically from top 
to bottom with sufficient speed that the eye will not perceive the scanning 

20 process. Display contents are thus depicted as picture elements or pixels. 
Each pixel corresponds to a specific time with respect to the start of a scan. 
Window 200 contains information related to a specific task being performed by 
computer system 100. The size and location of window 200 in display 112 may 
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be modified by the user as needed, usually via input device 114. A particular 
window 200 in display 1 12 is activated when first displayed or selected by the 
user as the active window 200. 

Referring now to FIG. 3, a block diagram for one embodiment of RAM 122 
of FIG. 1 is shown, in accordance with the present invention. In the FIG. 3 
embodiment, RAM 122 includes an application program 310 and an operating 
system 312. Application program 310, often created by an independent 
software developer, enables computer system 100 to perform a specific task, 
such as word processing, communication via the Internet, processing of 
numerical data in a spreadsheet, or playback of a multimedia file. A modern 
computer system 100 can simultaneously run multiple application programs 
310. Operating system 312 performs a multitude of tasks to simplify use of 
computer system 100. These tasks usually include installation and 
coordination of the various hardware components of computer system 100, 
creation and management of files, and operations relating to a graphical user 
interface in display 112. Window manager 314 is a subset of operating system 
312 that simplifies creation and management of windows 200. Creators of 
application programs 310 need only include calls to window manager 314 to 
inform operating system 312 that a particular size and type window 200 is 
required. Window manager 314 is specifically intended to minimize the 
software development burden faced by creators of application programs 310. 
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Referring now to FIG. 4, a block diagram showing one embodiment for 
the processing of display data is shown, in accordance with the present 
invention. In the FIG. 4 embodiment, application program 310 and 
operating system 312 share responsibility for managing windows 200. 

5 Application program 310 instructs operating system 312 to create window 
200 and thereafter supplies window content information to operating system 
312. In one embodiment, video RAM 120 (FIG. 1) contains the information 
to be placed onto display 1 12, including text, graphics, and window 
information from operating system 312 as well as window content 

10 information from application program 310. Video generator 126 repeatedly 
scans through video RAM 120 (FIG. 1) and produces appropriate video 
signals to be passed to display 112 to enable visual depiction of the contents 
of video RAM 120. 

In the FIG. 4 embodiment, display 112 comprises a cathode ray tube 

15 412, a video amplifier 414, and a window decoder 416. Video signals 418 
from video generator 126 are passed to video amplifier 414 and to window 
decoder 416. Window decoder 416 selectively generates a control signal 420 
to indicate to video amplifier 414 that a given picture element or pixel in 
display 1 12 is to be processed differently than other pixels. Video amplifier 

20 414 includes circuitry to responsively implement the desired special 

attribute, such as increased luminance, by responsively generating output 
signals 422 for cathode ray tube 412 based on video signals 418 from video 
generator 126 and the presence or absence of control signal 420 from 
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window decoder 416. In the event that window decoder 416 does not 
produce control signal 420 denoting the existence of a pixel to be specially 
processed, video amplifier 414 produces output signals 422 for cathode ray 
tube 412 that result in a regular depiction of video information. In the event 

5 that window decoder 416 does produce control signal 420 denoting the 
existence of a pixel to be specially processed, video amplifier 414 produces 
different output signals 422 for cathode ray tube 412 that will result in that 
pixel being specially displayed. For example, a pixel might be displayed with 
a relatively higher luminance level whenever window decoder 416 generates 

10 control signal 420. Synchronization of special pixel processing with the 
rastering process in display 112 results in the correct target areas of a 
special window 200 being specially processed. 

Referring now to FIG. 5, a diagram for one embodiment of a window 
15 200 in the FIG. 1 display 1 12 is shown, in accordance with the present 

invention. The window 200 in display 112 includes a frame 510, a content 
area 512, a first key signal 514, a second key signal 516, a vertical scroll 
bar 518, and a horizontal scroll bar 520. 

Operating system 312 creates and manages frame 510, while 
20 application program 310 provides information to be displayed in content 
area 512 to operating system 312. Frame 510 contains depictions of first 
key signal 514 and second key signal 516, which each contain information 
regarding the dimensions of the portion of content area 512 in display 112 
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to be specially processed. Frame 510 also includes window control tools, 
such as vertical scroll bar 518, and horizontal scroll bar 520. In an 
alternate embodiment, scroll bars 518 and 520 may help control special 
processing. For example, the position of a slide in horizontal scroll bar 520 

5 might denote the relative degree to which luminance levels are to be raised. 
The first key signal 514 preferably identifies and locates the upper left 
corner of the portion of content area 512 to be specially processed. The 
second key signal 516 preferably identifies and locates the lower right 
corner of the portion of content area 5 12 to be specially processed. 

10 Alternate key signal embodiments may include other information, 

such as a field to denote the selection of different types of special processing 
that display 112 can perform. Window manager 314 of operating system 
312 preferably creates both first key signal 514 and second key signal 516. 
Key signals should not interfere with normal window 200 operation, and 

15 should not distract the user. Display 112 depicts the information contained 
in first key signal 514 and second key signal 516 in a visually unobtrusive 
manner to be further described in connection with FIG. 6 below. Alternate 
embodiments of the present invention may handle multiple windows 200 to 
be specially processed. Similarly, windows 200 to be specially processed are 

20 not necessarily required to be rectangular in shape. A minimum size for 
windows 200 is determined by the size of key signals; in other words, key 
signals should not protrude beyond the frame 510 of windows 200. 
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In the preferred embodiment, video RAM 120 stores a digital 
representation of all pixels to be depicted on display 1 12. Window manager 
314 in operating system 312 encodes and stores both first key signal 514 
and second key signal 516 in video RAM 120, in the preferred embodiment. 

5 Application programs 310 define data to be displayed in content area 512 
and supply such data to operating system 312. The operating system 312 
defines all other data to be displayed. Video generator 126 then, in the 
preferred embodiment, scans video RAM 120, and produces video signals 
418 transmitting the entire contents of video RAM 120 to display 1 12. First 

10 key signal 514 and second key signal 516 are thus passed to display 112 
along with all other contents of video RAM 120, in the preferred 
embodiment. 

A second communications channel, such as a separate serial 
interface, is therefore not required. However, since the entire contents of 

15 video RAM 120 will be depicted on display 1 12, the information in first key 
signal 514 and in second key signal 516 should be encoded in a manner 
that will not be visually distinctive to the viewer when both key signals are 
depicted on display 112. Furthermore, key signals transmitted to 
conventional video monitors, i.e. those not equipped to perform special 

20 processing, should not cause malfunctions or display aberrations. 

Referring now to FIG. 6, a timing diagram for one embodiment of 
display data 610 encoded into exemplary pixels 612 is shown, in accordance 
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with the present invention. Display data 610 represents an arbitrary 
sequence of bits to be encoded into pixels 612 in a manner that will produce 
an unobtrusive achromatic gray when depicted on display 112. Display 
data 610 is presented for purposes of illustration, and other embodiments 

5 may readily contain different sequences of binary data. Each bit of display 
data 610 is represented by two pixels 612. Each pixel 612 has green, red, 
and blue content of various values. A re turn- to -zero encoding scheme is 
used so that a pair of up /down transitions occurs in one or two pixels 612. 
Green content is shown in a green waveform 614, red content is 

10 shown in a red waveform 616, and blue content is shown in a blue 

waveform 618. In the FIG. 6 embodiment, window manager 314 uses green 
waveform 614 as a clock to clearly define the duration of individual pixels 
612, which is analogous to individual pixel 612 width in a rastered display 
1 12. Use of pixel 612 color data, represented in the preferred embodiment 

15 by green waveform 614, as a clock renders use of a second clock 

communicated via a second communication channel (such as a serial 
interface card) unnecessary. In the preferred embodiment, a rising edge of 
green waveform 614 clocks in preceding data. Red waveform 616 carries 
display data 610. A transition from a high to a low display data 610 value 

20 or vice-versa causes red waveform 616 to alter its phase with respect to 

green waveform 614 as shown. The blue waveform 618 is the logical inverse 
of red waveform 616. 
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The mixture of the green, red, and blue content as given in green 
waveform 614, red waveform 616, and blue waveform 618, respectively, 
determines the overall perceived color of each resulting pixel 612. In all 
figures, these letters denote the following colors: R=red, G=green, B=blue, 

5 C=cyan, M=magneta, Y=yellow. In additive color systems, cyan results from 
an equal mixture of green and blue, magenta results from an equal mixture 
of red and blue, and yellow results from an equal mixture of red and green. 
Mixing a secondary color with an opposing primary color (one not contained 
in the secondary color) of equal luminance generally results in a mixture 

10 that appears gray to the viewer. When a pixel 612 of a primary color (red, 
green, or blue) is located next to a pixel 612 of a corresponding secondary 
color (cyan, magenta, or yellow, respectively) of proper brightness, the 
resulting pair of pixels 612 approximates a single achromatic gray pixel 612 
in appearance, given the limited spatial acuity of the human eye. Display 

15 112 thus depicts display data 610 without notable visual aberration when 
display data 610 is encoded into pixels 612 colored in this manner. In the 
preferred embodiment, a binary logic value of "1" is denoted by a yellow 
pixel 612 neighboring a blue pixel 612, and a binary logic value of "0" is 
denoted by a cyan pixel 612 neighboring a red pixel 612. The first key 

20 signal 514 and the second key signal 516 of the FIG. 6 embodiment are 
patterns of data display 610 bits that have been accordingly color-coded 
into pixels 612, forming embedded instructions to trigger special window 
processing. Modifications to this particular embodiment using 
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configurations other than those described above are intended to be covered 
by the present invention. For example, in some display systems it may be 
preferable to use red waveform 616 as a clock signal and blue waveform 618 
as the data signal. 

5 

Referring now to FIG. 7A, a block diagram for the preferred 
embodiment of a key signal format 710 for FIG. 5 key signals 514 and 516 
is shown, in accordance with the present invention. Referring also to FIG. 
7B, a table describing one embodiment for components 712 through 722 of 

10 the FIG. 7A key signal format 710 is shown. First key signal 514 and 

second key signal 516 each include fields of display data 610 bits as shown 
in key signal format 710. The data fields or key signal components include 
a start sequence (START) 712, a code sequence (CODE) 714, a horizontal 
offset (HOFF) 716, a vertical offset (VOFF) 718, a CRC checksum (CRC) 720, 

15 and a stop sequence (STOP) 722, as shown in FIG 7A and described in FIG. 
7B. These foregoing key signal components enable window decoder 416 to 
detect key signals 514 and 516, and to extract special window information 
reliably. Definition of special window coordinates relative to the beginning 
of vertical or horizontal scans of display 112 is more efficient than definition 

20 of absolute special window coordinates from a clock signal transmitted via 
an additional communications channel. Alternate embodiments may 
include other key signal components. Similarly, alternate embodiments 
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may use more complex key signals, such as a hidden watermark or a highly 
visible copyright or trademark logo. 

Start sequence 712 of the preferred embodiment is a 6-bit pattern in 
which the data on blue waveform 618 is equal to the data on red waveform 

5 616, i.e., logical inversion is not performed. This distinguishes start 

sequence 712 from code sequence 714, horizontal offset 716, vertical offset 
718, and CRC checksum 720, enabling window decoder 416 to reliably 
discern the presence of start sequence 712. Start sequence 712 clears 
registers and resets counters in window decoder 416, as will be detailed 

10 below. 

Code sequence 714 of the preferred embodiment is a unique 16-bit 
pattern used to distinguish the presence of first key signal 514 or second 
key signal 516 from other display data 610. Use of a unique pattern for 
code sequence 714 substantially reduces the likelihood that other display 

15 data 610 will accidentally be misconstrued as either first key signal 514 or 
second key signal 516 and trigger unintended special window processing. 
Different code sequences 714 are used for first key signal 514 and second 
key signal 516, with one preferably the logical inverse of the other. In the 
preferred embodiment, code sequence 714 for first key signal 514 is 

20 0001 101 1 1 1 100100, and code sequence 714 for second key signal 516 is 
111 00 10000011011. Both key signals should be found by window decoder 
416 during a single scan of display 1 12 in order to determine the presence 
of a window 200 to be specially processed. Use of a static pattern for first 
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key signal 514 or for second key signal 516 enables a static image of a 
special window alone to trigger special window processing whenever the 
static image is displayed. No separate signals are required to activate 
special window processing because the key signals are contained within the 
5 static image. 

Horizontal offset 716 of the preferred embodiment is a 9-bit pattern 
denoting the horizontal distance in pixels 612 from the beginning of a 
reference point to the horizontal edge of content area 512 that is to be 
differently processed. One bit of horizontal offset 716, preferably the ninth, 

10 is used as a sign bit indicating an offset to the left of the reference point if 
set, and an offset to the right of the reference point if not set. For first key 
signal 514, the reference point is the end of start sequence 712 of first key 
signal 514, so that the left border of the portion of content area 512 to be 
specially processed is located at the end of start sequence 712 plus or 

15 minus horizontal offset 716. For second key signal 516, the reference point 
is the beginning of stop sequence 722 of second key signal 516, so that the 
right border of the portion of content area 512 to be specially processed is 
located at the beginning of stop sequence 722 plus or minus horizontal 
offset 716. Summation of horizontal key signal reference positions and 

20 horizontal key signal offsets thus determines the horizontal coordinates of 
the portion of content area 512 to be specially processed. 

Vertical offset 718 of the preferred embodiment is an 8-bit pattern 
denoting the vertical distance in pixels 612 from the beginning of a reference 
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point to the vertical edge of the content area 512 to be differently processed. 
For first key signal 514, the reference point is the vertical line on which first 
key signal 514 begins, and the offset is counted downward. For second key 
signal 516, the reference point is the vertical line on which second key 
5 signal 516 begins, and the offset is counted upward. Summation of vertical 
key signal reference positions and vertical key signal offsets thus determines 
the vertical coordinates of the portion of content area 512 to be specially 
processed. 

Horizontal offsets 716 and vertical offsets 718 are necessary. 

10 Application programs 310 control the display data 610 to be depicted inside 
content area 512, while operating system 312 controls frame 510 and the 
key signals located in frame 510. In the preferred embodiment, both 
horizontal offsets 716 and vertical offsets 718 are set to default values that 
select entire content area 512 but not frame 510 elements such as scroll 

15 bars for special processing. Different offset values select a subset of content 
area 512 for special processing. 

CRC checksum 720 for horizontal offset 716 and vertical offset 718 is 
preferably an 8-bit polynomial data pattern, 1001 1001, used to reduce the 
possibility of error in the offsets. Stop sequence 722 of the preferred 

20 embodiment is a 6-bit data pattern in which the data on blue waveform 618 
is equal to the data on red waveform 616, i.e., logical inversion is not 
performed. As with start sequence 712, this distinguishes stop sequence 
722 from code sequence 714, horizontal offset 716, vertical offset 718, and 
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CRC checksum 720, enabling window decoder 416 to confirm the presence 
of stop sequence 722. 

Referring now to FIG. 8, a block diagram for the preferred embodiment of 

5 the FIG. 4 window decoder 416 is shown, in accordance with the present 

invention. In the preferred embodiment, window decoder 416 is intended to be 
fabricated onto a single low-cost ASIC (application-specific integrated circuit). 
In operation, video generator 126 (FIG. 4) creates a vertical synchronization 
pulse 810 to indicate the beginning of a new vertical scan of display 112 and a 

10 horizontal synchronization pulse 912 to indicate the beginning of a new scan of 
a horizontal line of pixels 612 on display 112. Video generator 126 also 
produces green waveform 614, red waveform 616, and blue waveform 618 as 
well as a signal from which clamp signal 814 is generated to indicate the black 
level of the incoming video waveforms. 

15 Incoming waveforms 614, 616, 618, and 814 are fed into an analog-to- 

TTL converter 816, which produces digital signals from each color waveform 
based on the respective signal levels at the time the clamp signal is asserted. 
In the preferred embodiment, if a color waveform is at the clamp voltage level, a 
logical zero is assigned to the digital signal corresponding to that color 

20 waveform. If a color waveform is at 700 millivolts with respect to the clamp 
signal voltage level, preferably, a logical one is assigned to the digital signal 
corresponding to that color waveform. In the preferred embodiment, the green 
signal from the analog- to-TTL converter 816 is used as a video clock signal 
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818. Video clock signal 818 is present only when first key signal 514 or second 
key signal 516 are being processed. A frequency control unit 820 selectively 
passes video clock signal 818 to a phase-locked loop (PLL) 822 to generate a 
separate but synchronous internal clock signal 824. Internal clock signal 824 

5 is necessary for clocking data into logic circuitry of window decoder 416; video 
clock signal 818 is not always available and thus cannot be used directly for 
this purpose. Internal clock signal 824 is available for use by all logic circuitry 
of window decoder 416, its connection to each logic circuitry element is omitted 
for clarity. An external low pass filter 826 is connected to the phase-locked 

10 loop (PLL) 822 which serves as an analog memory of the phase-frequency 
relationship between internal clock signal 824 and video clock signal 818. 

The coordinates of the current pixel 612 in display 112 are tracked by 
window decoder 416. Each pulse of internal clock signal 824 denotes a single 
pixel 612 and increments horizontal counter 828. Horizontal synchronization 

15 pulse 812 indicates the beginning of a scan of a new horizontal line, and resets 
horizontal counter 828 and increments vertical counter 830. Vertical 
synchronization pulse 810 denotes the beginning of a new scan of display 112 
and resets vertical counter 830. The location of any current pixel 612 can thus 
be determined by the contents of horizontal counter 828 and vertical counter 

20 8 30. 

Logic circuitry referred to as key signal verify A 832 in window decoder 
416 detects and verifies the first key signal 514. Identical circuitry referred to 
as key signal verify B 834 in window decoder 416 detects and verifies the 
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second key signal 516. Video clock signal 818 and TTL-level versions of red 
waveform 616 and blue waveform 618 are fed into the key signal verification 
circuits 832 and 834. Start sequence 712 triggers the key signal verification 
process of matching immediately following display data 710 with code 
5 sequences 714. If key signal verify A 832 successfully matches display data 
710 with code sequence 714 corresponding to first key signal 514, then window 
decoder 416 loads the first key signal 514 coordinates from horizontal counter 
828 and vertical counter 830 into start register 836. Similarly, if key signal 
verify B 834 successfully matches display data 710 with code sequence 714 
10 corresponding to second key signal 516, then window decoder 416 loads the 
second key signal 516 coordinates from horizontal counter 828 and vertical 
counter 830 into end register 838. 

Window decoder 416 performs additional checks to ensure the validity of 
key signals to prevent incorrect detection of windows 200 requiring special 
15 processing. Both key signals should be present for a number of scans of 

display 1 12 to enable special processing. The number of bits in the key signal 
data, that is, excluding start sequence 712 and stop sequence 722, should 
match the preferred number of key signal data bits. Additionally, the duration 
of key signals measured in terms of internal clock signal 824 periods is 
20 checked by window decoder 416. If the number of bits in the first half of a key 
signal does not match the number of bits in the second half of a key signal in a 
period of time determined by a number of internal clock signal 824 periods, the 
key signal is deemed invalid. The duration matching and bit counting 
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described above helps to verify that internal clock signal 824 is properly 
synchronized to video clock signal 818, farther preventing errors. 

Key signal verify A 832 and key signal verify B 834 also extract horizontal 
offset 716, vertical offset 718, and CRC checksum 720 for first key signal 514 

5 and second key signal 516, respectively. If no CRC error is found, window 
decoder 416 stores offset information for first key signal 514 in start offset 
register 840. Similarly, if no CRC error is found, window decoder 416 stores 
offset information for second key signal 516 in end offset register 842. 
Contents of start register 836 and start offset register 840 are summed by an 

10 adder 844 to compute the upper left coordinates of the portion of content area 

- L..ii, 

K 512 to be specially processed. Similarly, the contents of end register 838 and 

O 

;B end offset register 842 are summed by a second adder 846 to compute the 

: ass? 

iUJ lower right coordinates of the portion of content area 512 to be specially 

^9 processed. When key signal verify A 832 detects and verifies first key signal 

n S 15 514 and key signal verify A 834 detects and verifies second key signal 516, 
.OS enable control 848 sets an attribute denoting the presence of a window to be 

specially processed. Window decoder 416 monitors this attribute, and disables 
the attribute if no key signals are detected, indicating that there are no 
windows to be specially processed or that a special window exists but is 
20 occluded. 

Comparator 850 selectively generates control signal 420 based on the 
values of its inputs, which are the coordinates of current pixel 612 from 
horizontal counter 828 and vertical counter 830, the coordinates of the portion 
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of content area 512 to be specially processed from adders 844 and 846, and 
the attribute denoting the presence of a window to be specially processed from 
enable control 848. If the current pixel 612 is within the portion of content 
area 512 to be specially processed and a special window is present, then 
5 comparator 850 generates control signal 420. Power-on reset 852 produces 
reset signal 854 to initialize window decoder 416 when display 1 12 is first 
turned on. 

Referring now to FIG. 9, a flowchart for one embodiment of method steps 
10 to process special windows is shown, in accordance with the present invention. 
Initially, in step 910, window decoder 416 determines whether a new 
vertical scan of display 1 12 has started. Window decoder 416 accomplishes 
this by checking for the presence of vertical synchronization pulse 810. If a 
new vertical scan has started, then window decoder 416 proceeds to step 916 
15 to begin the process of identifying and locating special windows. If a new 

vertical scan has not started, then window decoder 416 proceeds to step 912. 

In step 912, window decoder 416 determines whether the current pixel 
612 is located within the portion of content area 512 to be specially processed, 
and whether an attribute denoting the activation of a special window is 
20 enabled. If the current pixel 6 12 is located within the portion of content area 
512 to be specially processed and the attribute denoting the activation of a 
special window is enabled, then, in step 914, window decoder 416 enables 
control signal 420. Control signal 420 is passed to video amplifier 414 to 
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indicate the presence of a pixel 612 to be specially processed. For example, if 
control signal 420 is enabled, video amplifier 414 may responsively increase 
the luminance of the current pixel 612. However, if the current pixel 612 is not 
located within the portion of content area 512 to be specially processed or the 
5 attribute denoting the activation of a special window is not enabled, window 
decoder 416 disables control signal 420 in step 915. Window decoder 416 then 
returns to step 910 to either process the next pixel 620 in step 912 or to begin 
the process of identifying and locating special windows in step 916. 

In step 916, window decoder 416 determines whether the attribute 
10 denoting the activation of a special window is enabled. If the attribute denoting 
the activation of a special window is enabled, then window decoder 416 
proceeds to step 918. If the attribute denoting the activation of a special 
window is not enabled, then window decoder 416 proceeds to step 922 to look 
for first key signal 514. 
15 in step 918, window decoder 416 determines whether at least one key 

signal (either first key signal 514 or second key signal 516) was detected in the 
previous scan of display 112. If at least one key signal was detected in the 
previous scan of display 112, window decoder 416 proceeds to step 912 to 
selectively process the current pixel 612, since at this point it is known that a 
20 special window has been activated but it is not yet known whether the current 
pixel 612 is within that special window. If no key signals were detected in the 
previous scan of display 112, window decoder 416 proceeds to step 920 to 
disable the attribute denoting the activation of a special window. Disabling the 
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attribute denoting the activation of a special window may be required because 
there are no special windows to be processed, or because a special window 
exists, but is now occluded by a standard window. 

In step 922, window decoder 416 determines whether both first start 

5 sequence 712 and first code sequence 714 have been detected, signifying that 
first key signal 514 has been found. If both first start sequence 712 and first 
code sequence 714 have been detected, then window decoder 416 proceeds to 
step 924. If either first start sequence 712 or first code sequence 714 have not 
been detected, then window decoder 416 returns to step 910 to either process 

10 the next pixel 6 12 in step 9 12 or to begin the process of identifying and 
locating special windows in step 916. 

In step 924, window decoder 416 stores information about the location of 
the upper left corner of the portion of content area 512 to be specially 
processed. Specifically, window decoder 416 stores horizontal offset 716, and 

15 vertical offset 718 from first key signal 5 14, and uses CRC checksum 720 to 
validate these values. Window decoder 416 also stores the vertical and 
horizontal position of current pixel 612 with respect to the upper left corner of 
display 112. The vertical position of current pixel 612 is computed from the 
count of the horizontal lines scanned since vertical synchronization pulse 810 

20 triggered a new scan of display 112. The horizontal position of current pixel 
612 is computed from the count of pixels 612 scanned since horizontal 
synchronization pulse 812 triggered a scan of a new horizontal line of display 
112. 
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Then, in step 926, window decoder 416 matches the frequency of video 
clock signal 818 with the internal clock signal 824. This is accomplished via 
frequency control block 820 and phase-locked loop 822. Video clock signal 
818 is known to be present because first key signal 514 has been detected in 

5 step 922 above, and one waveform of first key signal 514 (preferably green 
waveform 614) is used specifically for clocking purposes. The synchronization 
of video clock signal 818 and internal clock signal 824 guarantees that the 
intended width and duration of pixels 612 to be specially processed matches 
the actual width and duration of pixels 612 that are specially processed. The 

10 matching of pixel 612 widths prevents problems of horizontal pixel blurring 
that may occur in display systems using dual, versus single, communications 
channels. 

Then, in step 928, window decoder 416 determines whether both second 
start sequence 712 and second code sequence 714 have been detected, 

15 signifying second key signal 516 has been found. If both second start 

sequence 712 and second code sequence 714 have been detected, then window 
decoder 416 proceeds to step 930. If either second start sequence 712 or 
second code sequence 714 have not been detected, then window decoder 416 
returns to step 910 to either process the next pixel 612 in step 912 or to begin 

20 the process of identifying and locating special windows in step 916. 

Next, in step 930, window decoder 416 stores information about the 
lower right corner of the portion of content area 512 to be specially processed. 
Specifically, window decoder 416 stores horizontal offset 716, and vertical 
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offset 718 from second key signal 516 and uses CRC checksum 720 to validate 
these values. Window decoder 416 also stores the vertical and horizontal 
position of current pixel 612 with respect to the upper left corner of display 
112. The vertical position of current pixel 612 is computed from the count of 
5 the horizontal lines scanned since vertical synchronization pulse 810 triggered 
a new scan of display 112. The horizontal position of current pixel 612 is 
computed from the count of pixels 612 scanned since horizontal 
synchronization pulse 812 triggered a scan of a new horizontal line of display 
112. 

10 Finally, in step 932 window decoder 416 enables the attribute denoting 

the activation of a special window. By this point, window decoder 416 has 
located both first key signal 514 and second key signal 514 to identify the 
presence of a non-occluded special window. Window decoder 416 has also 
extracted all of the information regarding the location of the special window. 

15 The window decoder 416 then returns to step 910 to either process the next 
pixel in step 912 or to begin the process of identifying and locating special 
windows in step 916. 

The invention has been explained above with reference to a preferred 
20 embodiment. Other embodiments will be apparent to those skilled in the art in 
light of this disclosure. For example, the present invention may readily be 
implemented using configurations other than those described in the preferred 
embodiment above. Additionally, the present invention may effectively be used 
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in conjunction with systems other than the one described above as the 
preferred embodiment. Therefore, these and other variations upon the 
preferred embodiments are intended to be covered by the present invention, 
which is limited only by the appended claims. 
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WHAT IS CLAIMED IS: 

1. An apparatus for handling special windows in a display, comprising: 

a window manager to embed special window information in a video 
signal; and 

5 a window decoder to extract said special window information from 

said video signal and responsively generate a display control 
signal. 



2. The apparatus of claim 1, wherein said window manager is included in 
10 an operating system to simplify application software development. 

3. The apparatus of claim 1, wherein said window decoder is implemented 
as an application-specific integrated circuit. 



15 4. The apparatus of claim 1, further comprising: 

a target area in said special windows to be specially processed in 

response to said display control signal; and 
a video interface to transmit data including said special window 

information to said display. 
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The apparatus of claim 4, further comprising: 
pixels contained in said display; 

a first color signal serving as a video clock signal for said special 

window information; 
a second color signal including said special window information; 

and 

a third color signal. 

The apparatus of claim 5, further comprising: 

key signals including a pattern of bits of said special window 
information to encode a target area position, and corresponding to 
a pattern of said pixels depicted in said display. 

The apparatus of claim 5, further comprising: 

pixel pairs in said display, each member pixel of said pixel pairs 
being proximately located, said pixel pairs being colored according 
to said first color signal, said second color signal, and said third 
color signal in an additively complementary manner to visually 
approximate a single pixel of a mixed color. 
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The apparatus of claim 6 ? wherein components of said key signals 
include: 

a start sequence indicating a beginning of said key signals; 

a code sequence distinguishing said key signals from said data; 

a horizontal offset sequence indicating a boundary of said target 

area relative to a horizontal position of said key signals; 
a vertical offset sequence indicating a second boundary of said 

target area relative to a vertical position of said key signals; 
a CRC checksum verifying said horizontal offset sequence and said 

vertical offset sequence; and 
a stop sequence indicating an end of said key signals. 



The apparatus of claim 8, further comprising: 

nondifferential key signal data indicating said start sequence and 

said stop sequence; and 
differential key signal data indicating remaining components of 

said key signals. 



The apparatus of claim 8, further comprising: 

a number sequence indicating a number of special windows. 
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The apparatus of claim 8, further comprising: 

a shape sequence indicating a shape of said target area when said 
target area is not rectangular. 



The apparatus of claim 8, further comprising: 

a selection sequence indicating a selection from among a plurality 
of available special processes. 

The apparatus of claim 6, wherein scroll bars in said special windows 
function as controls for special processing. 

The apparatus of claim 6, wherein said key signals include hidden 
watermarks. 

The apparatus of claim 6, wherein said key signals include visibly 
apparent symbols. 
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The apparatus of claim 6, further comprising: 

key signal verification circuits identifying said special windows and 

responsively enabling an attribute; 
a vertical counter monitoring a number of vertically scanned lines 
of said pixels occurring after a vertical synchronization 
signal; 

a horizontal counter monitoring a number of horizontally scanned 
pixels after a horizontal synchronization signal; 

registers storing said target area position in terms of said vertically 
scanned lines and said horizontally scanned pixels when 
said attribute is enabled; 

a comparator monitoring a position of said pixels in terms of said 
vertically scanned lines and said horizontally scanned pixels, 
comparing said position of said pixels to said target area 
position, and responsively generating said display control 
signal to enable special processing. 
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The apparatus of claim 16, further comprising: 

an internal logic clock signal denoting an intended duration for 

said special processing of said pixels in said target area; and 

a frequency control unit synchronizing said internal logic clock 
signal to said video clock signal to regulate a horizontal 
width of said pixels in said target area with a duration of 
said display control signal, thereby calibrating said special 
processing with a scan of said display. 

The apparatus of claim 17, wherein said key signal verification circuits 
enable said attribute when a duration of said key signals in terms of 
internal logic clock signal periods is consistent with a key signal format. 

The apparatus of claim 16, wherein said attribute is disabled by an 
absence of said key signals. 

The apparatus of claim 16, wherein said key signal verification circuits 
enable said attribute when said key signals exist during one scan of said 
display and persist for a number of scans of said display. 
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21. A method for handling special windows in a display, comprising the steps 
of: 

embedding special window information in a video signal; 
extracting said special window information from said video signal 
5 using a window decoder; and 

generating a display control signal in response to said window 

information to enable different processing of said special 

windows in said display. 

10 22. The method of claim 21, wherein said step of embedding is performed by 
a window manager that is included in an operating system to simplify 
application software development. 

23. The method of claim 21, wherein said window decoder is implemented as 
15 an application-specific integrated circuit. 

24. The method of claim 21, further comprising the steps of: 

specially processing a target area in said special windows in 
response to said display control signal; and 
20 transmitting data including said special window information to 

said display using a video interface. 
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The method of claim 24, further comprising the steps of: 
depicting pixels in said display; 

transmitting a first color signal serving as a video clock signal for 

said special window information; 
transmitting a second color signal including said special window 

information; and 
transmitting a third color signal. 

The method of claim 25, further comprising the step of: 

transmitting key signals including a pattern of bits of said special 
window information to encode a target area position, and 
corresponding to a pattern of said pixels depicted in said display. 

The method of claim 25, further comprising the step of: 

depicting pixel pairs in said display, each member pixel of said 
pixel pairs being proximately located, said pixel pairs being colored 
according to said first color signal, said second color signal, and 
said third color signal in an additively complementary manner to 
visually approximate a single pixel of a mixed color. 



40 



The method of claim 26, wherein said step of transmitting said key 
signals further comprises the step of concurrently transmitting within 
said key signals: 

a start sequence indicating a beginning of said key signals; 

a code sequence distinguishing said key signals from said data; 

a horizontal offset sequence indicating a boundary of said target 

area relative to a horizontal position of said key signals; 
a vertical offset sequence indicating a second boundary of said 

target area relative to a vertical position of said key signals; 
a CRC checksum verifying said horizontal offset sequence and said 

vertical offset sequence; and 
a stop sequence indicating an end of said key signals. 



The method of claim 28, further comprising the steps of: 

transmitting nondifferential key signal data indicating said start 

sequence and said stop sequence; and 
transmitting differential key signal data indicating remaining 
components of said key signals. 
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30. 



The method of claim 28, further comprising the step of: 

transmitting a number sequence indicating a number of special 
windows. 



5 31. The method of claim 28, further comprising the step of: 

transmitting a shape sequence indicating a shape of said target 
area when said target area is not rectangular. 

32. The method of claim 28, further comprising the step of: 

10 transmitting a selection sequence indicating a selection from 

among a plurality of available special processes. 

33. The method of claim 26, wherein scroll bars in said special windows 
function as controls for special processing. 

15 

34. The method of claim 26, wherein said key signals include hidden 
watermarks. 

35. The method of claim 26, wherein said key signals include visibly 
20 apparent symbols. 
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The method of claim 26, further comprising the steps of: 

identifying said special windows and responsively enabling an 

attribute using key signal verification circuits; 
monitoring a number of vertically scanned lines of said pixels 

occurring after a vertical synchronization signal using a 

vertical counter; 
monitoring a number of horizontally scanned pixels after a 

horizontal synchronization signal using a horizontal counter; 
using registers to store said target area position in terms of said 

vertically scanned lines and said horizontally scanned pixels 

when said attribute is enabled; 
using a comparator to monitor a position of said pixels in terms of 

said vertically scanned lines and said horizontally scanned 

pixels, to compare said position of said pixels to said target 

area position, and to responsively generate said display 

control signal to enable special processing. 
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The method of claim 26, further comprising the steps of: 

denoting an intended duration for said special processing of said 
pixels in said target area using an internal logic clock signal; 
and 

using a frequency control unit to synchronize said internal logic 
clock signal to said video clock signal and regulate a 
horizontal width of said pixels in said target area with a 
duration of said display control signal, thereby calibrating 
said special processing with a scan of said display. 

The method of claim 36, wherein said key signal verification circuits 
enable said attribute when a duration of said key signals in terms of 
internal logic clock signal periods is consistent with a key signal format. 

The method of claim 36, wherein said attribute is disabled by an absence 
of said key signals. 

The method of claim 36, wherein said key signal verification circuits 
enable said attribute when said key signals exist during one scan of said 
display and persist for a number of scans of said display. 
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The method of claim 26, wherein said step of transmitting said key 
signals further comprises the steps of: 

transmitting a start sequence indicating a beginning of said key 
signals; 

transmitting a code sequence distinguishing said key signals from 
said data; 

transmitting a horizontal offset sequence indicating a boundary of 
said target area relative to a horizontal position of said key 
signals; 

transmitting a vertical offset sequence indicating a second 

boundary of said target area relative to a vertical position of 
said key signals; 

transmitting a CRC checksum verifying said horizontal offset 
sequence and said vertical offset sequence; and 

transmitting a stop sequence indicating an end of said key signals. 
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A system for handling special windows in a display, comprising: 

means for embedding special window information in a video signal; 
means for extracting said special window information from said 

video signal; and 
means for responsively generating a display control signal. 

A computer-readable medium comprising program instructions for 
handling special windows in a display by performing the steps of: 

embedding special window information in a video signal using a 

window manager; 
extracting said special window information from said video signal 

using a window decoder; and 
responsively generating a display control signal. 
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APPARATUS AND METHOD FOR 
HANDLING SPECIAL WINDOWS IN A DISPLAY 

ABSTRACT OF THE DISCLOSURE 

An apparatus and method for handling special windows in a display 
comprises a window manager in an operating system that is called by 
application programs to create special windows. The window manager 
embeds static key signals including encoded special window information, 
such as the coordinates of a window area to be specially processed, into a 
video RAM. An existing video interface scans the video RAM and transmits 
display information, including the key signals, to the display. The present 
invention further comprises a window decoder in the display, that detects 
the key signals, extracts the encoded special window information, and 
controls display circuitry performing the desired special processing. The 
key signal encoding scheme does not create visually discernible display 
aberrations that could distract the user or interfere with normal window 
management. 
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Title 97, Code of Federal Regulations, Section 136(a) which occurred between the filing date of live prior 
application and the rational or PCT international fl^g date of this application: 



(Application Serial Na) (Filing Date) (Status) (patented, pending, abandoned) 



(AppKcationSerialNo.) (Filing Date) (Status) (patented, pending, abandoned) 

I heteby appoint; 

John S. Ferrell, Reg. No. 34*593; J. Eppa Kid, Reg. No. 30,266; 
Charles B. Katz, Reg. No. 36,564; Gregory J. Koemer, Reg. No. 38,519; 
Dennis A- NicfcoHs, Reg. No. 42,036; Robert D, Wasscn, Reg. No. 40,218; 

Carr&RscrellLIP 
2225 East Bayshore Road, Suite 200 
Palo Alto, CA 94303 
TEL: (650)812-3400 ' 
FAX: (650)812-3444 

and M^Aakei, Reg. No. 32*67; Richard Iiu, Reg. No, 34377; Heteie Pkrtka Workman, Reg. No. 35 981; 
SEND ALL CORRESPONDENCE TO? 

Gregcttyj-Kheoifir 

Catx&BarrdlLLP 
2225 East Bayshore Road,, Suite 200 
Palo Alto, CA 94303 
TEL: (650)312-3400 
FAX (650)812^444 
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1 hereby declare that all statements made herein of my own knowledge axe true and that all statements 
made on Information and briirf aie believed to be true; and further that th^ae statements wen made with 
the knowledge that willful falsa statements and fee like so made are punishable by fine or imprisonment, 
or both, under Section 1001 of litis 18 of the United States Code and that such willful false statements 
may jeopardize the validity of the application at any patent issued thereon 

Full Name of Joint Inventor. RIchaTtj p. Canals Sr. 

Residence : _ 1187 Olive Branch Ln,,5an Toqfr CA 95130 



Post Office Address : Same C itizenship : USA 



Full Nam* of Joint InVento c ChtistophH. Kraly 



^ento'sSWtur e C\^A^fc^ . Dated; 2££epV< K°F $ 

Residency 6107 Ostenbeiy Drive. San Tna cCA 95120JJSA 

Post Office Address igams : QfaemMp Germany 



Full Name of Joint Inventor. Johanna M. Ayidinw^ 



Inventor's SWh ra y^^^y^lx, Au^U^l^ D flt ^ >3 £pf. f9? f 
Residence 1 649 fcmmarV Drive, Stitmy vale. CA 94087 USA m ( ^ 



